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Abstract 

We present a theory to describe the dynamics of the Sherrington- 
Kirlcpatrick spin-glass with (sequential) Glauber dynamics in terms of 
deterministic flow equations for macroscopic parameters. Two trans- 
parent assumptions allow us to close the macroscopic laws. Replica 
theory enters as a tool in the calculation of the time-dependent local 
field distribution. The theory produces in a natural way dynamical 
generalisations of the AT- and zero-entropy lines and of Parisi's order 
parameter function P{q). In equilibrium we recover the standard re- 
sults from equilibrium statistical mechanics. In this paper we make 
the replica-symmetric ansatz, as a first step towards calculating the 
order parameter flow. Numerical simulations support our assumptions 
and suggest that our equations describe the shape of the local field dis- 
tribution and the macroscopic dynamics reasonably well in the region 
where replica symmetry is stable. 
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1 Introduction 



The Sherrington-Kirkpatrick (SK) spin-glass model |j|] describes a collection 
of Ising spins, coupled by exchange interactions which are drawn at ran- 
dom from a Gaussian distribution. These interactions represent quenched 
(frozen) disorder. The equilibrium statistical mechanical description of the 
SK model seems to have reached a stable fixed-point, built on replica theory 
with, at least in the spin-glass phase, broken replica symmetry a la Parisi 
[^. A clear and extensive description of the formalism developed since 1975 
and most of the relevant references can be found in textbooks like the ones 
by Mezard et al and Fisher and Hertz [Q]. 

With respect to the dynamical properties of the SK model, the situa- 
tion seems different. The early dynamical studies, like ^ ^, were more 
or less of a pilot character, employing mean field approximations (MFA) 
and linearisations of the exact dynamic ensemble averages. Analytical work 
beyond MFA published so far has mostly concentrated on Langevin dynam- 
ics for soft spins, as opposed to Ising spins ||8|, ^ |lO|, 11|. In the Langevin 
case the standard procedure (described in detail in e.g. [12] and Q) is to 
construct a generating functional from a path integral representation of the 
microscopic state probability, which can subsequently be averaged over the 
quenched disorder (i.e. the random exchange interactions). This leads to 
a saddle-point problem, the limit ^ oo can be taken and one obtains a 
complicated set of equations for correlation- and response functions. These 
can be interpreted in terms of a Langevin equation for a single spin with 
a retarded self-interaction and a noise term with non-trivial moments. In 
order to proceed from this stage, additional assumptions, restrictions or 
approximations are needed, like expansions near critical lines or near equi- 
librium. By construction, in these theories only timescales which do not 
diverge with N are described. The approach followed by Sompolinsky in |^] 
is different: here a hierarchy of time-scales is introduced, all of which di- 
verge for N oo, but in a strict order. The case of Glauber ||l^ dynamics 
for Ising spins was studied by Sommers |jl^, who developed a path integral 
formalism by performing manipulations on the solution (in the form of a 
time-ordered product) of the master equation. His method, although subse- 
quently applied by other authors to related models like the non-symmetric 
SK model [|l^], was later criticised by Lusakowski [16|. As far as we are 
aware, the issue of the correctness (or otherwise) of the Sommers approach 
has not been settled. 

At zero temperature the SK model shows strong remanence effects (see 
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e.g. Kinzel [IT^]), with a non-exponential decay of the magnetisation. Only 



recently numerical evidence has been published |18] which suggests that 



infinite-range models such as the SK model even exhibit ageing effects of 



the type observed in experiments on real spin- glasses [Q, 19 1, which until 
now were always assumed to be typical for finite-range models and therefore 
explained using scaling arguments for growing domains. 

Motivated by the non-trivial dynamical phenomena exhibited by the 
SK model and by the restricted theoretical understanding of the Glauber 
dynamics (as opposed to the continuous Langevin approach), we develop in 
this paper a theory to describe the Glauber dynamics of the SK model in 
terms of deterministic flow equations for two macroscopic state variables: 
the magnetisation m and the spin-glass contribution r to the energy. Our 
reasons for choosing these two quantities as dynamic order parameters, in 
favour of a dynamical equivalent of the spin-glass order parameter q or its 
distribution P{q), are: 

1. On finite time-scales both m and r evolve in time deterministically in 
the limit N ^ oo. 

2. The Hamiltonian of the SK model can be expressed solely in terms of 
m and r. 

3. In thermal equilibrium m and r are self- aver aging with respect to the 
quenched disorder in the limit N ^ oo (since m and the free energy 
are M 



4. Both m and r are instantaneous functions of time for a single system, 
whereas P{q) involves correlations between different times or systems. 

The key to closing the deterministic laws is to calculate the distribution of 
time-dependent local aligment fields. Two transparent physical assumptions 
allow us to calculate this distribution analytically and find a closed set of 
flow equations for our two order parameters. The theory produces in a 
natural way dynamical generalisations of the AT- and zero-entropy lines 
and of Parisi's order parameter function P{q). In equilibrium we recover 
the standard results from equilibrium statistical mechanics. The present 
formalism has previously been applied succesfully to a related model: the 



Hopfield neural network model near saturation |21|. 

In our view the main appeal of our formalism is its transparency. The 
theory is formulated in terms of two directly observable macroscopic state 
variables and, apart from two simple assumptions, derived directly from the 
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microscopic stochastic equations. Secondly, an interesting difference with 
existing approaches is the way in which rephca theory enters. In the stan- 
dard Langevin approach (after having taken the hmit oo) one ends up 
with quantities and equations very much hke the ones encountered in equi- 
hbrium rephca theory, with rephca indices replaced by time arguments. In 
Sompolinsky's theory replica indices are replaced by labels of the hierarchy 
of time-scales. In contrast, in the present formalism replica theory enters as 
a mathematical tool in calculating the time-dependent distribution of local 
alignment fields. The only uncertainty in the status of the theory originates 
from the two closure assumptions, since all subsequent calculations can in 
principle be performed exactly. Both are supported to a certain extent by 
evidence from numerical simulations. A recent study of an exactly solvable 



toy model [^, stimulated by the work reported here and in ||2lj], suggests 
that the proposed closure procedure succeeds in capturing the main physics 
in a closed set of transparent deterministic equations and is exact for t = 
and t = oo, but does not reproduce all temporal characteristics for inter- 
mediate times. Since the closure procedure is based on the elimination of 
microscopic memory effects, the theory can contribute to a better under- 
standing of the relation between the microscopic processes and correlations 
and the macroscopic measures of complexity, such as the order parameter 

In this paper we develop the general formalism. However, in calculating 
the order parameter flow explicitly we will make the replica-symmetric RS 
ansatz. We will show that in most of the flow diagram replica symmetry is 
stable. In the region where the RS solution is unstable the flow direction 
is still described correctly and the RS theory even predicts non-exponential 
relaxation for T ^ 0, but the RS equations fail to describe a rigorous slowing 
down which, according to simulations, sets in near the de Almeida-Thouless 
[p3| line. In a subsequent paper we shall address the implications of replica 



symmetry breaking. 

2 Dynamics of the Sherrington-Kirkpatrick Spin- 
Glass 
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2.1 Definitions and Macroscopic Laws 

The Sherrington-Kirkpatrick (SK) spin-glass model describes N Ising 
spins (Jj G { — 1, 1} with infinite-range exchange interactions Jij: 

Jij = ^Jo + -y^J^ii < j) (1) 



where the quantities Zjj, which represent quenched disorder, are drawn in- 
dependently at random from a Gaussian distribution with {zij) = and 

(4) = 1- 

The evolution in time of the microscopic state probability pt{cr) is of the 
Glauber [13| form, described by a continous-time master equation: 

d ^ 

-rPtio-) = [pt{Fk(T)wk{Fkcr) - pt{(T)wk{o-)] (2) 

"-^ k=i 

in which Fk is a spin-fiip operator Fk^{cr) = <5(cri, . . . , —ak, ■ ■ ■ , (Tat) and 
the transition rates Wk{a) are 

'Wk{s) = ]-[l-ak tanh[/3/ife(cr)]] hi{a) = ^ Jijaj + 9 

which leads to the required standard equilibrium distribution 

i<j i 

(for numerical simulations we resort to a discrete-time sequential process, 
where the Wk{cr) are interpreted as transition probabilities and with iteration 
steps of duration For N ^ oo this must reproduce the physics of the 

continuous-time equation [^). The energy per spin can be written in terms 
of two macroscopic quantities 

m(a) = — CTj ria) = — aoZnaj (3) 

H{a)/N = -ijom2(cr) - 9m{a) - Jr{a) + h^/N (4) 

These two observables, the magnetisation and the energy contribution in- 
duced by the quenched variables {-Zjj}, will be used to define a macroscopic 
state. The corresponding macroscopic probability distribution is 

Vt{m, r) = ^p((cr) 6 [m — m{a)] 6 [r — r(cr)] (5) 
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By inserting the microscopic equation (|2|) and after defining the 'discrete 
derivatives' Aif{a) = f{Fia) — f{cr), we obtain 

d d i 1 



_ d_ 
dr 

with the sub-shell average 



(6) 



Y.aPM¥ [m-m{a)] 5 [r-r{a)] ^{a) 



r:t 



J2cTPt{(^)^ [m-m{a)] 5 [r-r{a)] 
The local alignment fields and the 'discrete derivatives' are given by 



hi{a) = Jom(cr) + Jzi{a) + 9 + 0( 



N' 



Ziicr 



2 2 
Aim{cr) = -j^CFi Air{cr) = -—aiZi{(T) 

With these expressions and the transition rates (||) we can evaluate (^): 



|Pt(m,r) = -A|p,(^,,) 



N 



m,r\t 



m 



i=l 



d_ 

dr 



Pt{m,r) 



N 



{—^Zi{cr)tanhP{Jom+Jzi{cr)+e))m,r;t - 2r 



i=l 



(7) 

In the limit — > oo equation (|^) acquires the Liouville form and describes 
deterministic flow at the macroscopic level (m, r). The evolution of the 
dynamic order parameters (m, r) is governed by the flow equations 

d f 

-m= j dz Dm,T;t[z\iaunh. 13 {Jom + J z + 6) — m (8) 



dt 
d 



—r = J dz Dm,r;t[z]z tanh (3 {Jqiti + Jz + 6) — 2r 



(9) 



All complicated terms are concentrated in the distribution of spin-glass con- 
tributions Zi{cr) to the local fields: 

n ri Y.(7Pti(^)^['m-m{a)]6[r-r{(T)]j^Y.iS[z-Zii(T)] 

Dm,vM = hm — -— T—v^Ti TT^ 

X.crPn'^)'^ ["i-m(cr)J 5 [r-r(<T)J 

Thus far no approximations have been used; equations (|8|,^) are exact for 
N ^ oo. 
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Figure 1: Trajectories in the (m,r) plane obtained by performing sequential 
simulations of the SK model with T = 0.1, J = 1 and Jq = 0, for t < 10 
iterations/spin. 

2.2 Closure of the Macroscopic Laws 

The flow equations are not yet closed: they contain the distribution Dm,r;t[z] 
(|To|), which is defined in terms of the solution pt{cr) of the microscopic 
equation (§) . In order to close the set we make two simple assumptions 
on the asymptotic (A^ oo) form of the local field distribution Dra,r]t[A'- 

[i) The deterministic laws describing the evolution in time of the order 
parameters (m, r) are self-averaging with respect to the distribution of 
the quenched contributions Zij to the exchange interactions. Therefore 
the local field distribution Dm,r;t[z\ is self-averaging as well. 
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Figure 2: Trajectories in the (m, r) plane obtained by performing sequential 
simulations of the SK model with T = 0.1, J = 1 and Jq = 1, for t < 10 
iterations/spin. 
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Figure 3: Trajectories in the (m, r) plane obtained by performing sequential 
simulations of the SK model with T = 0.1, J = 1 and Jq = 2, for t < W 
iterations/spin. 
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{ii) In view of (i) we assume that, as far as the calculation of -Dm,r;t[-2] 
is concerned, we may assume equipartitioning of probability in the 
macroscopic (m, r) subshells of the ensemble. 

Assumption (i) allows us to simplify the problem by performing an average 
over the (quenched) random variables {zij}. As a consequence of assumption 
(ii) the explicit time-dependence in the flow equations (|^,§) and the depen- 
dence on microscopic initial conditions are removed, since the distribution 
Dm,r;t[z] will be replaced by: 

n ri 1- ,J2aH'"^-m{(^)]Hr-r{cT)]jfY.iHz-Zii(T)] 
Dr^Az]^hn^J j:^S[m-mia)]6[r-r{a)] ^^-^^ ^'^^ 

For sequential dynamics, the first of our two assumptions is clearly sup- 
ported by experimental evidence (sequential simulations at T = 0.1), which 
we present in figures |ll (for Jq = 0, where the system evolves towards a 
true spin-glass state), |2| (for Jq = 1, which marks the onset of a non-zero 
equilibrium magnetisation) and ^ (for Jq = 2, where the system evolves to- 
wards a ferro-magnetic state). Each of the flow graphs corresponds to one 
particular realisation of the quenched disorder {zij}. The initial states gen- 
erating the different trajectories (labelled by ^ = 0, . . . , 10) were drawn at 
random according to Po{ct) = Hi + ifjl'^o-i,! + ]f)]'^Si,-i , such that 
that {m)t=Q = 0.1£ and {r)t=o = 0. With increasing system size, fluctua- 
tions in individual trajectories eventually vanish and well-defined flow lines 
emerge, which no longer depend on the disorder realisation. The second clo- 
sure assumption can only be tested in such a direct manner by comparing 
the actual local field distribution, measured during simulations, with the 



result of evaluating (11). This will be done in a subsequent section. 

In equilibrium studies the above two assumptions are in fact the basic 
building blocks of analysis as well, where (i) is assumed and (ii) is a conse- 
quence of the Boltzmann form of the microscopic equilibrium distribution. 
Our aim is to calculate analytically the — > oo fiow illustrated in figures || 
to m, by combining equations (^,^) with (11). The distribution (^) will be 
calculated using the replica method. 
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2.3 The Local Field Distribution 



We use the following replica expression for writing expectation values of a 
given state variable ^ over a given measure W: 



a=l 



which allows us to write (|T^) in the replica form. By writing the delta- 
functions in integral representation we obtain 



Drr,.Jz] = I ^e"'^ hm 



N 
2^ 



2n 



with 



We now perform the average over the quenched variables {zy} in M{<t°}, 
with the result: 



0{1/N) 



in which we have introduced the familiar order parameters qap{cr) = ^t'^i ■ 
If we again introduce appropriate delta- functions, 



1 = dq 6[q- q{a) 



' N' 


"1 


.2vr. 





dqdq e*^Ec/3'?"/3[<?-/3-9"/3 ('^)] 



we can reduce the spin-averages to single-site ones. The result can than be 
written in terms of an n-replicated Ising spin (ui, . . . , cj„): 



DmrU] = I ^e-3^'+"" lim 
"•'^ ^ ' 27r n^O 



' N' 




.27r. 





dmdrdqdq eiE.^^«]'+0(VA^) 



xe 



N'^{rh,r,q,q) /c 



1 



"^{rh, r,q,q) =iY^ [rf„ + mrha] + i ^1 9"/39a/3 " 7 XI ^^llp^P 
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+ log(e"'^-'^""""'^"/5^'^''"""'')o- (12) 
For large N the integral is evaluated by steepest descent and we obtain 

Dm,rM = / ^e-^-^+-^ lim A£ ^ ^ ^ (13) 

in which the order parameters {m, f, q, q} are found by selecting the saddle- 
point of \I' dl^), which gives a minimum with respect to variation of the 
order parameters Qafs- Variation of allows us to eliminate already one 
set of conjugate parameters: qaf3 = —^iQap'f'aT^p- The remaining conjugate 
parameters, uniquely determined by the saddle-point requirement, turn out 
to be purely imaginary: = ipa and with which we obtain the 

following saddle-point equations: 

m = % ^ (14) 



{aaCTf^e 



lap = -Tv^ (15) 

^gZ^7 ^7^^7+2 l^^S <1-,SP-/PS<^-I<^S^^ 

Y,qlppp = 2r (16) 
The exponent ^ can be simplified to: 



*=-^E/'--"^E/^"-iE Po^ll-yPl + 10g(eS^ '?7.P7P.-7-.)^ 

a. a. 0:7 

(17) 



and the distribution [2] becomes 

Drar\z\ = / ^e-^^''+^^^ lim 



, ^ /„-«2:X]7°'t^t'?17+Z]t.'^t'^t + 5Z]-,«975P7P«o"70"5\ 



27r n^O ^gI]7'^^'^^ + ^Z]-y5 975P7P5'^7f^«^^ 



(18) 



The physical meaning of the order parameters go,^, which in the present 
theory are functions of the two macroscopic state variables m and r, can 
be inferred in the usual manner by considering two spin systems, a and <t', 
with the same microscopic realisations of the quenched disorder. For such 
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systems we define the disorder- averaged probability distribution Pmr-io) for 
the mutual overlap between microscopic configurations if both systems are 
constrained on the same macroscopic (m, r) subshell: 



Pmr{q) 



J2a,a'^ Q-W^kf^kcr'k S [m-m{a)] 5 [r-r{a)] 5 [m-m{(T')] 5 [r-r{a')] 



)0 



J2(j cr' ^ ['m — m{a)] 5 [r — r{a)] 5 [m — m{cr')] 6 [r — r{cr')] 



1 



lim 

n^o n[n — l) 



N 



lim 



\{5[m-m{a^)]5[r-r{a^)]){a^^){^^ 



7=1 



1 



n^o n{n — 1) 



(19) 



This dynamical equivalent of Parisi's Q equilibrium order parameter func- 
tion will, in the present theory, depend on time through the values of the 
two macroscopic parameters (m, r). 

The saddle-point exponent ^ that is extremised in the replica calculation 
of the local field distribution has an entropic physical interpretation. We 
define the entropy per spin S for the instantaneous macroscopic state (m, r) 
as 



1 



S= lim — \og'S^ 5 \ra — mia)] 5 \r — r(cr)] 



(20) 



Using the replica trick log Z = lim^^o ^ [Z"" — 1] and averaging over the 
quenched disorder allows us to express S in terms of the saddle-point prob- 
lem encountered in calculating Dmr[z\'- 



S = log 2 + lim lim 



{{YlHrn- m{cT-)] 6 [r - r(^")])){,-.},{,,^} - 1 



a=l 



log2 -h lim 

n-»0 n 



(21) 



in which ^' is the saddle-point exponent (fi7\). The entropy S again depends 
on time through the values of the macroscopic state variables {m,r). 
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2.4 Equilibrium 

For large times the microscopic probabihty distribution pt{cr) converges to 
the static Boltzmann expression Z^^e^^^^^^ (with the partition function 
Z = J2a e^^^^^^)- Since H{a) (^ can be written in terms of the macro- 
scopic state variables m[a) and r(cr), at equilibrium we automatically ob- 
tain equipartitioning of probability in the (m, r) sub-shells of the ensemble 
(equipartitioning in the energy shells is an even stronger statement). This 
removes the need for the second of our closure assumptions, leaving need 
only for our assumption that the evolution of m and r is self-averaging. We 
will now demonstrate that in equilibrium we do recover the full standard re- 
sults from equilibrium statistical mechanics, including the replica symmetry 
breaking (RSB) equations. 

The standard replica formalism as applied to the SK model (see e.g. [^] 
or Q ) leads in the thermodynamic limit — > oo to the following expressions 
for the disorder-averaged free energy per spin / 

f = — — log 2 -|- lim min F(m, q) 

j2 



(22) 



The corresponding saddle point equations are 



(23) 



0:7 \ 



_ \^l^a--' l_0_ /24) 

and the physical interpretation in terms of the two (disorder-averaged) func- 
tions P{q) and P[m) is: 



P{q) ^ 8 



acT' 



1 ^ , 



-PH((T)-f3H{a')y 



li^o^;^5'^''"'""^ (25) 



15 



m- 



N 



lim — 6\m — m„l 



(26) 



According to Parisi's Q theory the magnetisation is self-averaging, even in 
the regime where rephca symmetry is broken |2C], so P(m) is a deha- function 
and rua = m for ah a. From the internal energy in thermal equilibrium 
E/N = [1-I-/39/3]/, which is also self-averaging |2C], we obtain the equilibrium 
expression for our dynamic order parameter r: 



1 



' eq 



/3J 



1 



dq P{q)q' 



For (3Jq < 1, where nieq = 0, the continuous transition at PJ = 1 from the 
paramagnetic phase with P{q) = 5{q) to the spin-glass phase, is therefore 
marked by r^q = \. 

Comparison with the dynamical eqns. (14,15,16), shows that the two 
approaches yield identical equations if we impose the following conditions: 



/i = /3( Jom + 6) 



(27) 



Below we show that these conditions turn out to be precisely those which 
imply dynamical stability with respect to the macroscopic flow (^J9|); 



dt' 



-m 



0, 



d 

—1 
dt 







and hence they also describe the same equilibrium physics. 

First we consider the evolution of m, using the noise distribution (|T8| ) 
and the conditions (^)- If we perform a shift of the integration line for z 
and perform the integral over x we arrive at: 

d ,v /n (tanh[pz+M+p2^„gi„a„] 6^^.'^-+^^'^.^"-^"-"^) 

—m = — m+lim / Dz 

dt n^O 



1 12 

(27r)~2e~2^ dz. In the numerator of this ex- 



with the abbreviation Dz 
pression we perform the average over ai explicitly, and use the identity 

e'^y Dz ta.-nh[pz-p^ + u] + j Dz tcmh.[pz+ + u] = 2sinh[n] (28) 
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to arrive at: 



—m = -m + lim n~7v^ = ^ 



'"7 0-5 ^ 



(utilizing (||)). 

In a similar way we obtain for the evolution of r: 

—r = — 2r+ lim / Dz 

at n^O J 

{[z+pEa QiaCTa] tanh[pz + ^ + p2 q,^a^] e^^-r 



70"(5 \ 



^g''^7 "7 ' 2f ^7« 

Again we perform the average over o"i in the numerator explicitly, simplify 
the result with the identity 

e~" J Dz [pz-p^+u] tanh[p2;-p^+u] +6^ j Dz [pz+p^+u] tanh[pz+p^+'u] 

= 2usinh[n] +2 p^ cosh[ti] (29) 

and arrive at: 

— r = -2r + hm {p + py^ qia TTY^ 

at n^O 1 ^g/^Z^^'^7+2^' Z^^i'?7«o"70-i^^ 

= lim p — 2r = 

(utilizing (0Jl|)). 

Finally we use the equilibrium conditions (27) to show that the ther- 
modynamic entropy per spin S = 0^dpf in equilibrium coincides with the 
dynamic entropy per spin S given by (|20|) : 



5 = log 2- lim |mM + ^ygL--log(e^^"""+^^'S-."""^'^"^)^ 



According to ( [T7| ) and (21) this expression is identical to the one we obtained 
for S. 
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3 Replica Symmetry 

3.1 Replica-Symmetric Local Field Distribution 

We first make the replica-symmetric ansatz (RS) and assume Pmrio) (|l9|) 
to be a delta- function, so qap = Sa/s + — Sa/s)- From this ansatz the 
saddle-point equations (14,15,16) allow us to deduce /ia = and pa = P- 
For n ^ we obtain: 



m = J Du ta.nh{p^u + fi) 
g = y Du tanh^ {p^/qu + p) 



2r 



P 



l-g2 

The corresponding local field distribution D^f[z] becomes: 
dx 1^2, 



(30) 

(31) 
(32) 



D, 



— e 2^ +*^^ hm / cosh [p-v/gii + zU — ixp] cosh" [pJqu+p — ixqp] 



We first perform the shift u — > f + ix^, after which the limit n ^ can be 
safely taken. In the resulting expression we can perform the integral over x. 
After some final transformations of integration variables we arrive at 



e 2 



i[2+p(l-g)]2 



2V27r 



|l+ Joy tanh py^/q{l-q)-pq [z+p{l-q)]-p 



+ ■ 



2V27r 



^+ joy tanh py^q{l-q)+pq [z-p{l-q)]+p 



(33) 



This expression cannot be simplified further, except for three special cases 
which we will discuss below. 



Prom expression ( |33D and the saddle-point equations it is clear that 
D^f[z] is Gaussian only along the line r = 0: 



r = : 



1 _ 1 ^2 

e 2^ 



(34) 



For r = we obtain q = m? . We can identify such macroscopic states as 
purely ferromagnetic (for m 7^ 0) or paramagnetic (for m = 0). The result 
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is indeed what one would obtain in thermal equilibrium for f3J = 
(where only the para-magnetic and purely ferromagnetic states are found). 

A second simplification of ( |33| ) results for q = (the paramagnetic state) , 
which can only occur along the line m = 0. For m = the RS saddle-point 
equations reduce to 



Fiq) 



Du tanh^ 



1 



with the properties 
F(l) 



1 



F{q) 



from which we conclude that along the m 
{q = 0) state for r < 

1 ^r,^. , 1 



Ar'^q - 32r^g2 + 0{q^) 

line we find a paramagnetic 



m 



0, r < 



-|[2+2r]2 



+ 



1 



e 2^ 



(35) 



2 ^ 2V2vr ■ 2V27r 

This result is indeed what one would obtain for the field distribution in 
thermal equilibrium in the paramagnetic region of the phase diagram |25]. 
For r > ^, m = we obtain a spin-glass with q 0, where again we know 



from equilibrium studies [^5| that the local field distribution indeed has a 
non-trivial form like that in (|33[). 

The third simplification occurs for g ~ 1. Expanding the saddle-point 
equations in powers of e = 1 — g gives the leading orders 



re'^ + ... 



re ""^V^ erf ^{m) + ... 

-[crf-i(m)]^ 



(36) 
(37) 



Equation (13 7| ) defines the line in the (m, r) plane where the situation q = 1 
actually occurs. Near this line we can use the scaling relations (3(:) to show 



that expression ( |33D reduces to the Schowalter-Klein |26] form, which in 
equilibrium would be obtained in the limit of zero temperature |2^ (in RS 
approximation) : 



^m,r(m) \A 



+ 



/27r 

,-i[2-r(m)]2 



2tt 



-z — r(m) — \/2 erf "^{m) 
— r{m) + ^/2 erf^^( 



(38) 



in which r(m) denotes the q = ^- line (^). 
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3.2 Special Lines in the Flow Diagram 

In order to check the apphcabihty of the RS ansatz we calculate the equiv- 
alent of the RS zero-entropy ('freezing') line in the (m, r) plane (where the 
number of microscopic configurations contributing to our averages vanishes) , 



and the de Almeida-Thouless (AT) line |2S], where a replica-symmetry 
breaking (RSB) solution of the saddle-point equations bifurcates from the 
RS saddle-point. 



In RS theory the dynamic entropy ( pOD is, according to ([2l|), given by 
Srs = log2 + Jdu log cosh [pu^/q+^l] - m^j. + ^p^(l-g)^ - pr (39) 
For r = (where there is no spin-glass alignment) the entropy reduces to 

/•tSunh"^ (\m\) p -, 

Srs, r=o = log 2 - / ds s 1 - tanh2(s) G [0, log 2] 

Jo L J 

with S RS, r=o = log 2 at m = (the para-magnetic state) down to Srs, r=o = 
at m = ±1 (the fully ordered ferro- magnetic state). Along the line m = 0, 
below r = i, we find q = and Srs = log 2 — > 0. Using the scaling 
relations (^) one can finally show that near the q = 1 line (|3^) the RS 
entropy is negative, except for \m\ = 1, r = 0, where the q = 1 line and 
the line Srs = meet. Since the physical dynamical entropy cannot be 
negative this already signals an inadequacy in the RS ansatz, analogous to 
that found in the equilibrium RS theory of SK |Q. The full curve Srs = 
signals this inadequacy in (m, r) space. 

An AT-line ||2^ signals the first continuous bifurcation of a saddle-point 
solution without replica symmetry from the replica-symmetric one. We fol- 
low the usual convention and assume that the first such bifurcation is the 
replicon mode: 

QaP ^ q + Sqal3, Pa = P, /J-a = P 

Inserting this ansatz into the full saddle point equations shows that the 
RSB bifurcations are of the form J2aj^i3 ^Qa/S = 0. After some bookkeeping 
and after taking the limit n — > one then obtains the bifurcation condition 
which defines the dynamic AT line: 

I- jou coshr\p^y + /i] = (40) 
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Figure 4: AT line (large dashes), RS freezing line (dashes/dots) and q = 1 
line (small dashes) in the (m, r) plane. 
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The RS solution is stable as long as the left-hand side of ( ]40| ) is positive. 
For r = (with \m\ < 1) the RS solution is indeed stable. The AT line 
intersects the line m = at r = i. Using the scaling relations ( |36| ) one can 
also show that near the q = I line (^^ the RS solution is unstable, except 
for \m\ = 1, r = 0, where the q = 1 line and the AT line meet. 

In figure ^ we show the freezing line (where S^s = 0) (H); the AT line 
( ^0|) and the q = 1 line (|37[ ) in the (m, r) plane. We note that the q = 1 
line always lies above the Sjis = line, which in turn lies above the AT 
line, except at \m\ = 1, r = 0. Thus the AT line is the critical one for 
replica symmetry. The separation between the AT line and the q = 1 line, 
which provides an effective boundary for the (m, r) dynamics, is greatest for 
small m where the ferromagnetic order is small and occurs for large r, when 
spin- glass alignment is greatest. 

Below the AT line the RS solution is stable against RSB fluctuations. 
The RS solution breaks down in the region where ferromagnetic order is 
small and spin-glass type field-alignment dominates. 



3.3 Replica-Symmetric Flow Equations 

By combining the equations (|8|,^) with expression ( p3[ ) we arrive at a closed 
set of autonomous differential equations describing the deterministic evolu- 
tion of the macroscopic state (m,r): 



-m 



di' 
d 

—1 
dt 



J j DxDy M{m, r; x,y) — m 
DxDy R{m, r; x, y) — 2r 



(41) 
(42) 



in which 

M{m, r; x, y) 



1 
2 

1 

+- 



1 — tanh 



1+tanh 



xpJq{l-q)+pqy + f^ 



xp\ q{l-q)+pqy+p 



tanh f3[Jom+Jy+0- J p{l-q)] 
tanhf3[Jom + Jy + e + Jp{l-q)] 



R{m,r;x,y) = 
\ [y-p(l-g)] 



1 — tanh 



xpJq{l-q)+pqy+fi 



tanh/3 [jQm+ Jy+6 — J p{l — q)] 
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+ 2 



■q)] 



1+tanh 



tanhP[Jom + Jy + 9 + Jp{l-q)] 



with {q,p,fj,} being functions of the macroscopic state {m,r), to be solved 
from the saddle-point equations (3C,31,32). 

In figure 3^ we compare the flow defined by ( [4l| , p2[) with numerical sim- 
ulations for = 3000, 6 = 0, J = 1, Jq £ {0,1,2} and four choices of 
the temperature T. The parameters Jq and T have been chosen in such a 
way that the corresponding equilibrium situations (according to standard 
equilibrium theory Q) include spin-glass states (Jq < 1, T < 1), states with 
ferro-magnetic order (Jq > 1, T < Jq) and para-magnetic states (Jq < T, 
T > 1). At intervals of At = 1 iteration/spin we measure the macroscopic 
order parameters (m, r) in the simulated system and calculate the deriva- 
tives {■§[fn.,-^r) as predicted by The initial states generating the 
trajectories (labelled by £ = 0, ... , 10) were drawn at random according to 



Po{s) = rii 



such that that {rn)t=o = 0.1£ 



and (r)t=o = 1- The figure indicates that the flow is described quite well by 
( ^l| , ^2| ), except for those regions in the (m,r) plane where the RS solution 
is unstable (above the AT line). More detailed comparisons between theory 
and simulations will be made in a subsequent section. 



From the RS saddle-point equations (30,31,p2) we can directly recover all 



equilibrium results obtained by Sherrington and Kirkpatrick [|l|, . Inserting 
the two relations p = j3J and p = P{Jom + 9) into our RS saddle-point 
equations gives 

Du tanh/3( Jom+ Jy^n- 



m 



q — J tanh^ P{jQ'm+ J ^/qu + 9) 



We now use the identities (|28| , P9|) and perform a rotation in the space of the 
gaussian integrals in (^,^2[) to arrive for the RS thermal equilibrium state 
of i0 at 

— m = / Dx tanh.p{Jom + J^/qx + 9) — m = 

(Jib J 



d_ 
lit 



r = j3Jq 



q ~ j Dx tanh^ j3{jQm+ J ^/qx+9) 
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Figure 5: Trajectories in the (m, r) plane obtained by performing sequential 
simulations of the SK model with N = 3000 and zero external field , for 
t < 10 iterations/spin (solid lines), together with the velocities as predicted 
by the theory (arrows, calculated at intervals of 1 iteration/spin for the in- 
stantaneous macroscopic state of the corresponding simulation, at the point 
of the base of the arrow). The first row of graphs corresponds to T = 1.5, 
the second to T = 1.0, the third to T = 0.5 and the fourth to T = 0. Dashed 
lines indicate the q = 1 line (upper), the RS freezing line (middle) and the 
AT line (lower). 



The RS order parameter equations in thermal equilibrium, as derived in 
[0, 0, thus indeed define fixed-points of our flow equations, as also follows 
from our more general analysis of section 2.4. 

If we insert the fixed-point relations into our expression (|40| ) for the AT 
line, we obtain: 

1 = /32j2 J Dx cosh-^ p{Jom+J^x+e) 

which, again, corresponds exactly to the result obtained in thermal equi- 
librium 1 23]. This includes both the line segment separating paramagnetic 
from spin-glass phase, where (meq,req) = (0, ^), and the line segment sep- 
arating the replica-symmetric and replica-symmetry broken ferromagnetic 
phases. 

Our dynamical RS laws (^J4^) thus lead precisely to the thermal equi- 
librium described by Sherrington and Kirkpatrick [|l|, |^ and de Almeida 
and Thouless [23|, including entropy and stability with respect to replica- 
symmetry breaking. 



3.4 Relaxation Times 

We will investigate the asymptotic behaviour of the RS flow equations. For 
simplicity and to suppress notation we restrict ourselves to the case Jq = 0, 
J = 1. We expand both RS flow equations (|^,P) around the equilibrium 
state (m, r) = (0, rgq) 

m{t) = em{t) + 0{e^) r{t) = r^q - ef{t) + ©(e^) 

req = ^/3(1 -q^) q = joy tanh^ [(3^y] (43) 
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as well as the RS saddle-point equations (3C,31,32): 



\ dm J 0. 



(44) 



4q 



J Du tanh^(/3My^) — q 



dq\ ^ 

5ryo,r,q /3(l+3g2) 2g(l-g2)(i + 3g2)-2_ j^^^2tanh2(/3u^) + (7 

(45) 

The linearised flow equations decouple since {dmD)^^ [z] and {drD)^^ [z] 
are respectively anti-symmetric and symmetric in z (this decoupling does 
not depend on replica symmetry). As a result we directly obtain the two 
relaxation times: 



lim — log 

t^oo t 

- lim — log 



rh{t) 
m(0) 



^- Jdz {dmD)^l^ [z] tanh [pz] (46) 



f(0) 



dz{drD)^l^ [z]ztanh[/3z] 



(47) 



In the paramagnetic temperature region T > 1 the partial derivatives of the 
local field distribution ( |33|) can be calculated easily. We find 



= 1- Jdz tanh(/32;+/?2) 
= 2 - 2 J Dz z{z+p) tanh(/3z-F/3^ 



(48) 



(49) 



For r < 1 more work is required to find the partial derivatives (dD) and 
the relaxation times. 

We first turn to the magnetisation. After some bookkeeping we can 
derive from (33): 

{dmD). [z] = ^ ^ {1- I Dj/tanh^ A 2/(7^) +(z-A) 



e 2 



' 2(1- 



/27r [ J 
1- /Dytanh^A 



y 



1- 



1- 



+ (z+A) 



1- 



2(l-g)\/27r 

where A = (3{1 — q). With this expression we obtain, after a rotation in the 
space of the integrals: 

1 -a 



jDy l-tanh\py^) jDz[l-tanhp {y^+z^T^+Pil-q))] 



(50) 
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Figure 6: The two asymptotic RS relaxation times and for Jq = ^ = 
and J = 1 as a function of temperature. 
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For non-zero temperatures the asymptotic relaxation of m described by the 
RS equations is indeed exponential. For T — > 0, however, we can use q ~ 
1 — (3~'^\/^ to show that the relaxation becomes non-exponential: 



hm T- 

p—i-oo 



1 f 1 -1^2 r /2 . d . ^ 

- dz e 2 ggn[2;+Y— J — sgn[2;J 







Next we turn to the relaxation of r. Taking the appropriate derivatives 
results in 



l + q 



2^^ 



1 + ^(1 + 3,^) 



dq\ 

drJeq 



Dy [l+tanh(/3yV9)] J Dz [tanh(/3Q)+/3Q \l-iai\h^{(3Q) 

Dy y\l-t&nh^{(3y^)\ [ DzQ tanh{pQ) 
Dy[l+tanh{Py^)] [ Dz 



eq 



2^ 2^1^ 
tanh(/3Q)+/3Q l-tanh2(/?g) 



(51) 



with the abbreviation Q = y y^q) + z^/l — q + P{1 — q) (to be used in combi- 



nation with ([45[)). Numerical evaulation of the integrals in (48,49,5C,51) as 
a function of temperature results in figure ^. Note that in the absence of 
spin-glass interactions (i.e. for J = 0) one would simply find = 1 for all 
T. Both relaxation times diverge for T — > 0, with liuiT^o Tr/Tm = 0. 



4 Further Comparisons with Numerical Simula- 
tions 

In this section we present some more detailed simulation experiments, the 
outcome of which is compared to the predictions of our RS theory (the 
latter need not give sensible results above the AT line). The simulations 
can display two types of finite size effects: thermal fluctuations in the flow 
of the order parameters (i.e. finite size corrections to the Liouville equation 
(0)) and fluctuations in the local field distribution (i.e. finite size corrections 
to the steepest descent integration leading to (0)). 
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Figure 7: Trajectories in the (m, r) plane obtained from sequential simula- 
tions of the SK model with N = 3200, J = 1 and T = 0.1, for three different 
choices of Jq. Initial states: {m,r) (0.5,0). Dots indicate times at which 
the spin-glass contributions to the local fields are measured in order to test 
the theory. 
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Figure 8: Comparison between RS theory (dashed hnes) and the local field 
distribution as measured during the Jo = simulation. 
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Figure 9: Comparison between RS theory (dashed hnes) and the local field 
distribution as measured during the Jq = 1 simulation. 
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Figure 10: Comparison between RS theory (dashed hnes) and the local field 
distribution as measured during the Jq = 2 simulation. 
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4.1 The Local Field Distribution 



First we compare our analytical result (^) directly with the outcome of 
measuring the spin-glass contributions to the local alignment fields during 
actual numerical simulations. In order to probe the different regions of the 
(m, r) plane we performed simulations from the initial state (m, r) ~ (0.5, 0) 
for Jo = 0, Jo = 1 and Jq = 2 and measured the instantaneous distribu- 
tion of the spin-glass contributions to the local alignment fields at different 
times. In figure |^ we show the resulting trajectories in the (m, r) plane 
(solid lines), together with the AT line (lower dashed line) and the q = 1 
line (upper dashed line). Dots indicate the instances were the relevant mea- 
surements were done: t = 0, t = l, t = 5 and t = 10 (unit: iterations per 
spin) . In figures |8|, |9| and |l^ the distributions as measured from the full mi- 
crostate cr{t) (histograms) and calculated from ( ^3|) with only m{t) and r{t) 
as input (dashed lines) are shown. The RS theory leading to the distribu- 
tion (^) turns out to give a good qualitative description of the simulation 
data; significant deviations are confined to the region above the AT line. 
Below the AT line these numerical results partially justify a posteriori the 
ansatze of self-averaging and subshell equipartitioning, made to close the set 
of deterministic dynamical laws for the order parameters m and r. 



4.2 Cooling in a Small External Field 

Next we study the evolution in time of the order parameters m and r that 
results after cooling the system instantaneously from T = oo, the paramag- 
netic state {m,r) = (0,0), to T = 0.1. For simplicity we choose Jq = and 
J = 1. An external field 9 = 0.1 is applied in order to obtain non-trivial 
evolution for the magnetisation (this field being small assures the macro- 
scopic state vector eventually enters into the spin-glass region of the (m, r) 
flow diagram, above the AT line). 

In figures H and In] we compare the result of performing numerical 



simulations (for an = 3200 system) with the result of solving numerically 
the RS flow equations (|8|,P). At least within the duration of the numerical 
experiments (t < 10 iterations/spin), the direction of the flow in the (m,r) 
plane is correctly described by the RS flow equations, even above the AT line. 
Within the limitations of our simulations the RS theory, however, breaks 
down even before the AT line is crossed, in that the RS flow equations fail 
to describe an overall slowing down of the macroscopic flow. 
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Figure 11: Flow in the (m, r) plane of the order parameters m(t) and r{t), 
at T = 0.1 with a small external field 6 = 0.1. Initial state: {m,r) = (0,0) 
(the paramagnetic state). Fluctuating lines: three independent N = 3200 
simulations. Smooth solid line: solution of RS flow equations. Dashed lines: 
the q = 1 line (upper) and the AT line (lower). 
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Figure 12: Evolution in time of the order parameters m(t) (left picture) 
and r{t) (right picture), at T = 0.1 with a small external field 9 = 0.1. 
Initial state: (m,r) = (0,0) (the paramagnetic state). Fluctuating lines: 
three independent N = 3200 simulations. Smooth line: solution of RS flow 
equations below AT line. Dashed line: solution of RS flow equations above 
AT Une. 



35 



Figure 13: Flow in the {m,r) plane of the order parameters m(t) and r{t), 
at T = 0.0 with Jq = 6 = and J = 1 from the fully magnetized initial state 
{m,r) = (1,0). Fluctuating lines: three independent = 3200 simulations. 
Thick solid line: solution of RS flow equations. Dashed lines: the q = 1 line 
(upper) and the AT line (lower). 



4.3 Decay from a Fully Magnetized State 

Finally we study the relaxation from the fully magnetized initial state (m, r) = 
(1,0) (a la Kinzel |17|, albeit for short time-scales t < 10 only). For sim- 



plicity we choose Jq = 6 = and J = 1. Figures 13 and 14 show the result 
of comparing numerical simulations for an = 3200 system with the result 
of solving numerically the RS flow equations (|8|,^). Again within the dura- 
tion of the numerical experiments (t < 10 iterations/spin) the direction of 
the flow in the (m, r) plane is correctly described by the RS flow equations, 
whereas the RS theory apparently fails to describe the overall slowing down 
that sets in even before the AT line is crossed (which gives rise to the famil- 
iar remanent magnetisation |jl^ ) . In order to describe the slow relaxation of 
this remanent magnetization above the AT line, measured rather in terms 
of a few thousand iterations per spin, we clearly need the RSB version of 
our theory. 
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Figure 14: Evolution in time of the order parameters rn{t) (left picture) and 
r(t) (right picture), at T = 0.0 with Jq = 9 = and J = 1. Fluctuating 
lines: three independent N = 3200 simulations. Smooth line: solution of 
RS flow equations below AT line. Dashed line: solution of RS flow equations 
above AT line. 
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5 Discussion 



In this paper we have developed a dynamical theory, valid on finite time- 
scales, to describe the Glauber dynamics of the SK model in terms of de- 
terministic flow equations for two macroscopic state variables: the mag- 
netisation and the spin-glass contribution to the energy. Two transparant 
physical assumptions, based on a systematic removal of microscopic memory 
effects, allow us to calculate the time-dependent distribution of local alig- 
ment fields in terms of the instantaneous prder parameters only and thereby 
obtain a closed set of flow equations for our two order parameters. The 
theory produces in a natural way dynamical generalisations of the AT- and 
zero-entropy lines and of Parisi's order parameter function P{q). In equilib- 
rium we recover the standard results from equilibrium statistical mechanics, 
including the full RSB equations. 

In calculating the order parameter flow explicitly we have made the 
replica-symmetric (RS) ansatz, as a natural first step. A subsequent paper 
will be devoted to the implications of breaking the replica symmetry (RSB). 
We found that in most of the flow diagram replica symmetry is stable. 
Numerical simulations suggest that our equations describe the shape of the 
local field distribution and the macroscopic dynamics quite well in the region 
where replica symmetry is stable. In the region of the flow diagram where the 
RS solution is unstable the flow direction as given by the RS theory seems 
still correct and the RS theory even predicts non-exponential relaxation 
in the limit T ^ 0. However, the RS theory fails to describe a rigorous 
slowing down which, according to simulations, sets in near the de Almeida- 
Thouless [23 1 line. Intuitively one expects the breaking up of phase space, 
as indicated by the breaking of replica symmetry, to have a slowing down 
effect on the macroscopic flow. Preliminary investigations of the effect of 
replica symmetry breaking, based on expansions just above the AT line and 
on a one-step symmetry breaking a la Parisi, show that this is indeed the 
case [27|. 

The main appeal of our formalism we consider to be its transparency. 
The theory is formulated in terms of two directly observable macroscopic 
state variables: the magnetisation and the spin- glass contribution to the 
energy per spin. Furthermore the macroscopic laws are derived directly from 
the underlying microscopic stochastic equations, given two key assumptions. 
An interesting difference with existing (mostly Langevin) approaches is that 
in the present formalism replica theory enters naturally as a mathematical 
tool in calculating the time-dependent distribution of local alignment fields. 
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One of the two assumptions on which our analysis is based (self-averaging of 
the macroscopic laws with respect to the frozen disorder) is quite standard. 
Both assumptions are supported by evidence from numerical simulations. 
Based on the agreement between theory and simulations in the RS region 
we believe that our two closure assumptions lead to a theory which captures 
the main physics of the order parameter flow of the SK model on finite 
time-scales, and that the impact of microscopic memory effects (which in 



the theory are explicitely removed) can be viewed, as in |21, p^, principally 



as an overall slowing down. Our next step will be to investigate in detail the 
RSB version of our dynamical laws, which will be the subject of a subsequent 
paper. 
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